Multi-Valued Neuron with Sigmoid Activation Function for Pattern Classification
نویسندگان
چکیده
Multi-Valued Neuron (MVN) was proposed for pattern classification. It operates with complex-valued inputs, outputs, and weights, and its learning algorithm is based on error-correcting rule. The activation function of MVN is not differentiable. Therefore, we can not apply backpropagation when constructing multilayer structures. In this paper, we propose a new neuron model, MVN-sig, to simulate the mechanism of MVN with differentiable activation function. We expect MVN-sig to achieve higher performance than MVN. We run several classification benchmark datasets to compare the performance of MVN-sig with that of MVN. The experimental results show a good potential to develop a multilayer networks based on MVN-sig.
منابع مشابه
A Multi-valued Neuron with a Periodic Activation Function
In this paper, a new activation function for the multi-valued neuron (MVN) is presented. The MVN is a neuron with complex-valued weights and inputs/output, which are located on the unit circle. Although the MVN has a greater functionality than a sigmoidal or radial basis function neurons, it has a limited capability of learning highly nonlinear functions. A periodic activation function, which i...
متن کاملImplementation of a programmable neuron in CNTFET technology for low-power neural networks
Circuit-level implementation of a novel neuron has been discussed in this article. A low-power Activation Function (AF) circuit is introduced in this paper, which is then combined with a highly linear synapse circuit to form the neuron architecture. Designed in Carbon Nanotube Field-Effect Transistor (CNTFET) technology, the proposed structure consumes low power, which makes it suitable for the...
متن کاملMODELLING A NEURON USING A CUSTOM MATH LIBRARY sfloat24 – IMPLEMENTATION OF A SIGMOID FUNCTION ON A FPGA DEVICE –
Artificial neuron networks base their processing capabilities in a parallel architecture. This makes them useful to solve pattern recognition, system identification and control problems. In this paper is described an artificial neuron implementation on a FPGA device by using a custom sfloat24 math library. Using this library have been implemented some activation functions of an artificial neuro...
متن کاملPerformance Evaluation of Recurrent RBF Network in Nearest Neighbor Classification
Superposition of radial basis functions centered at given prototype patterns constitutes one of the most suitable energy forms for gradient systems that perform nearest neighbor classification with real-valued static prototypes. It has been shown in [1] that a continuous-time dynamical neural network model, employing a radial basis function and a sigmoid multi-layer perceptron subnetworks, is c...
متن کاملRBF-based neurodynamic nearest neighbor classification in real pattern space
Superposition of radial basis functions centered at given prototype patterns constitutes one of the most suitable energy forms for gradient systems that perform nearest neighbor classification with real-valued static prototypes. It is shown in this paper that a continuous-time dynamical neural network model, employing a radial basis function and a sigmoid multi-layer perceptron sub-networks, is...
متن کامل